Using Connectionist Models to Evaluate Examinees’ Response Patterns on Tests: An Application of the Attribute Hierarchy Method to Assessment Engineering
نویسندگان
چکیده
The purpose of this study is to describe how the attribute hierarchy method (AHM) can be applied to assessment engineering. The AHM is a psychometric method for classifying examinees’ test item responses into a set of attribute mastery patterns associated with different components in a cognitive model of task performance. Attribute probabilities, computed using a neural network, can be estimated for each examinee thereby providing specific information about the examinee’s attribute-mastery level. The pattern recognition approach described in this study relies on an explicit cognitive model to produce the expected response patterns. The expected response patterns serve as the input to the neural network. The model also yields the cognitive test specifications. These specifications identify the examinees’ attribute patterns which are used as output for the neural network. The purpose of the statistical pattern recognition analysis is to estimate the probability that an examinee possess specific attribute combinations based on their observed item response patterns. Two examples using student response data from a sample of algebra items on the SAT illustrate our pattern recognition approach.
منابع مشابه
The optimum support selection by using fuzzy analytical hierarchy process method for Beheshtabad water transporting tunnel in Naien
The engineers can frequently encounter with the situation to select the optimum option among the alternatives related with tunneling operations. The optimum choice can be selected by the experienced engineers taking into consideration their judgment and intuition. However, decision-making methods can offer to the engineers to support their optimum selection for a particular application in a sci...
متن کاملAttribute Reliability in Cognitive Diagnostic Assessment
The attribute hierarchy method is a psychometric procedure for classifying examinees’ test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. Results from an AHM analysis yield information on examinees’ cognitive strengths and weaknesses. Hence, the AHM can be used for cognitive diagnostic assessment. The p...
متن کاملApplication of AHP and ELECTRE models for assessment of dedesertification alternatives
The assessment of de-desertification alternatives can be effective in controlling the reclamation of disturbed landand avoiding destruction of areas at risk. Until now, there has been no method to consider different criteria andalternatives, or to present the optimum alternatives based on systematic structures and experts’ perspectives.Desertification is a complex process resulting from various...
متن کاملInvestigating the Cognitive Attributes... 1 Running Head: USING ATTRIBUTE HIERARCHY METHOD ON A READING TEST Investigating the Cognitive Attributes Underlying Student Performance on a Foreign Language Reading Test: An Application of the Attribute Hierarchy Method
Educational assessments are designed to facilitate teaching and learning. To achieve this purpose, the psychology underlying student performance must be well understood because most tests are based on cognitive problem-solving tasks. This calls for the integration of cognitive psychology with educational assessments. The present study illustrates the use of the attribute hierarchy method (AHM) ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007